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ABSTRACT 

A variety of pressures from students, alumni, 
legislators, and administrators has led to increasing concern about 
the quality of college instruction. In education and psychology, 
innovation frequently involves either the development of more precise 
behavioral approaches or more humanistics approaches; yet innovation 
often occurs without systematic consideration of broad goals and 
purposes. Failure to analyze goals and purposes lead too easily to 
fragmentary conceptions of how instruction should be planned, 
implemented, and evaluated. The Learner Controlled Instruction (LCI) 
approach attempts to define broad goals and to use an adaptation of 
Glaser's Basic Teaching Model to provide a framework for 
instructional design and evaluation. The learner assumes considerable 
autonomy in deciding what and how to learn and in evaluation; he has 
responsibility, however, for clarifying his goals and intentions and 
communication with the instructor. The goals and purposes of LCI are 
examined in relation to the cognitivee and affective taxonomies, 
Torrance's definition of creativity^ and Parnes" creative 
problemsolving model. A variety of criteria are described for 
evaluating instructional innovations in three categories: basic 
psychological aptitudes and traits; student report data; and 
internalization and application criteria. (Author) 
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People seem to be getting more and more concerned about the quality of 
Instruction at the college level. Our students, once docile and submissive, are 
aggressive and active about the quality of teaching. Those who make decisions 
about merit, promotion, and tenure are facing increasing pressures for systematic 
evaluation of teaching. New emphases on "accountability^' inevitably include some 
concern for the quality of instruction. These pressures and concerns could pro- 
vide impetus for the rejuvenation and re-direction of higher education, which 
some predict is urgently needed for Institutional survival (e.g., Freedman and 
Sanford, 1973). More realistically, however, we seem most often merely to be 
''tinkering" with bits and pieces of the structure, trying to add a support here- 
or a patch there. 

For those of us 1 n education and psychology, common changes have involved 
movement in a direction toward either more ''humanistic" instruction or toward 
new and sophisticated behavioral approaches. In some part, at least, movement 
in the former direction seems often to be associated with increased concerns for 
student needs and interests, the studen+-centered curriculum, and what we might 
call the rhetoric of personal relevance or significance. On the other hand, 
movement towards more behavioral orientations appears to be more responsive to 
the current wave of concern for accountability and the impact of modern technology. 
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Neither direction. Involving extremes at either end of the scale as well as 
more "i-oderate'" Interventions, seems to result from a systematic, pianful 
examination of the broad goal?, of higher education. Nor have we examined the 
kinds of instructional decisions necessary to foster progress toward the attain-- 
ment of broad educational goals. We really have not asked the very fundamental 
questions, '"'Why are we teaching, anyway?" and ''What does that have to say about 
how we are teaching?'* 

Our lack of attention to goals and purposes increases the chance for us to 
be swept along in one current or another in our general orientation. It also 
allows us to pursue isolated or fragmented conceptions of how to go about 
implementing change in the actual conduct of instruction. 

Without a keen sense and concern for purpose, we may drift rather easily 
from the incorporation of one novel strategy to another In our teaching, or 
perhaps even worse, pick up bits and pieces from here and there with very little 
sense of whether our effort has any potential value for getting us where we 
wanted to go. More than a decade since Its origin, Robert Mager's Sea Horse 
fable, from 1962, still seems to serve good warning upon usi Once educators 
were aglow over the potential of programmed instruction, but taps have been 
sounded (Feldhusen, 1963). Now it is modular instruction, mi ni -courses, L'AI or 
audlo-tutoria I ; "one cannot help but wonder if anyone has asked, ''\'hy?^' Lectures 
aren^t as popular anymore as when I was an undergraduate, and now we ail tend to 
see more films, and literally to play more games, to micro- teach and to define 
the minimum competencies which are requisite for our students, 

I hope you will not misunderstand me. I have no special axes to grind about 
these things. Movies, i :i cro-teach I ng, mini-courses, and the like, and maybe 
even the old standard lecture, aren't the villains here; for generally, they are 
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not inherently *'good ' or ^'bad." But we seem to have become the villains, when 
we lurch out of one kind of instruction and into another without knowledge, or 
even much concern, about what we're trying to accomplish or how our methods 
and procedures might help or hinder us in reaching the goals for which education 
exists. 

Finally, we have been 'tinkering'' recently with a variety of evaluation 
models. We all have heard about a full range of "techniques'' — from "testing 
is for the birds — no more tests — everybody gets an A^' to "set the standards in 
advance, and take the tests over until you reach the standard.'' We have seen 
self-evaluation, norm-referenced-eva I uation, criterion-referenced evaluation, 
personal growth, and non-evaluation. If it sounds confusing, pause to consider 
the plight of today^s undergraduate who has, no doubt, lived through most all 
of these — and perhaps through several in any given semester. 

I suppose It is obvious by now, but my thesis Is that we should not be 
innovating in college instruction for reasons like these. We ought not be 
operating so mindlessly, so carelessly, or perhaps not quite so fashionably. 
We ought not be viewing instructional innovation as an end in itself, and, I 
think, we must exercise some caution in the university so that the mere act of 
innovation doesn't become se I f -reward i ng. 

Let me attempt to illustrate an alternative. It's yet a small program, not 
a major national thrust, and not dally !n the eye of the public. It may thus 
be presumptuous to use it this way. I offer it only to illustrate one way in 
which some of us are seeking to change our own efforts more systematically. At 
Purdue, I began working a few years a^o with Kent Davis on an approach . we We 
consistently called LCI for "Learner Control led Instruction." Since I moved 
to Kansas, Kent and I have continued our work by mal I, through occasional 
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visits, and with our students, and some K.U. colleagues have also joined the 
venture. The entire framework Is yet evolving, rather than static and existant, 
and so we should really speak of what we're trying to do, rather than what wo 
did. 

First of all, we are concerned with articulating a set of goals and purposes 
to serve as general Indicators of what we believe Instruction should seek to 
accomplish. We have stated these goals In the form of a series of questions 
(Trefflnger and Davis, 1971), broadly derived from a familiar model of Instruc- 
tion (Glaser, 1962), and also In much briefer form, as a set of general propo- 
sitions about the purposes of instruction (Trefflnger, 1973). These propositions 
are stated in Table 1. 

Even though we may depart from tradition by beginning with the question of 
purpose as viewed by the learner rather than the teacher, we believe that these 
general propositions would ordinarily be considered worthwhile purposes, and 
that they are consistent with the goals that are generally expressed and supported 
for higher education. We believe, then, that there is ''face validity" for the 
purposes we have described. In addition, we believe that, under examination 
using several approaches or models of instruction, our purposes would also be 
regarded as plausible and desirable outcomes. 

We have attempted to Incorporate psychological knowledge about learning, 
development, and instruction, from both experimental and humanistic traditions 
into a new model, in which components which are compatible and mutually suppor- 
tive have been synthesized. 

In developing and defining Instructional procedures, we have looked at these 
purposes, and attempted to plan options for learners which will provide many 
cpn9i^"3nt opportunities or paths for the learner to attain the goals. Acquisition 
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of content has not been sacrificed In this effort, although It has assumed a 
secondary role. In fact, we may have leaned in the direction of being even 
less "prescriptive'^ of content than we might have been without having to sacri- 
fice the orientation which begins with the student. We have sought generally 
to develop our approach consistently with a psychological rationale for Instruc- 
tion Feldhusen and I presented earlier (Feldhusen and Treffinger, 1971), 
although an alternate approach recently described by Feldhusen et ^1. (1973) 
probably attempts to establish an even closer correspondence. In moving from 
the stage of considering purposes to designing procedures , we have dealt with 
several factors at once. We have had to ask both : "What do we know about the 
psychological background and rationale for certain Instructional procedures?" 
and ^^Among the many procedures available, which can most effectively facilitate 
progress toward the attainment of the general goals?" 

Emphasis has been on the creative, independent inquiry of the learner, 
stressing self-direction which begins with the selection or development of 
objectives and continues throughout the instructional episode. This emphasis 
IS clear In our statement of purposes, which can be related rather easily to 
the phases of Torrance's (1966) definition of creative thinking or Parnes' 
(1967) formulation of the creative problem solving process. We are also con- 
cerned with affective outcomes (Krathwohl, 1964) as well as several levels of 
cognitive outcomes (Bloom, 1956), Table 1 summarizes our statement of purpose 
and illustrates relationships with each of these additional models. 

From the statement of purposes for LCI, and with utilization of other 
supporting psychological theory and research, we feel that It should be possible 
to develop a more systematic approach to Instructional Innovation, to examine 
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closely the suftabfllty of alternatfve IfisfrucNonal procedures, and to develop 
hypotheses about strategies for meeting more effectively the needs of many 
dl f ferent learners , 

We are also concerned with the problem of evaluation . How do we decide 
whether or not a particular Innovation in instruction is worth being used? Does 
it real ly accomplish what it purports to do? Does it serve those purposes 
rrore effectively than might be accomplished using some other approach? For 
what students does it have the greatest (or least) appeal and effect? Ttiese 
are very difficult questions; unfortunate /y, we do not yet have very complete 
answers for them. 

One of the most difficult problems, of course, has to do with the identifi- 
cation of appropriate criteria for answering such questions. It is very clear, 
as supported In the extensive study reported by Dub In and Taveggla (1968), that 
we will not be able to get the information we need from students' scores on 
such course achievement measures as final examinations. Dubin and Taveggia, 
who surveyed studies of the effectiveness of various teaching methods, as reported 
over a period of some four decades, concluded that, when the utility of a method 
fs assessed through final course exam! nations, there are In general ''no dif- 
ferences that amount to anything.'' (1968, p. 8). Such achievement measures 
also seem to be inappropriate to use for the evaluation of an instructional 
approach in which the acquisition of a fixed body of content for all students 
is not a principal outcome • 

It seems necessary, instead, to begin with the staterr.ent of goals and pur- 
poses. This would facilitate identification of evaluation criteria for 
assessing the effectiveness of: the approach. : ■ ' 



It Is very easy to fall Into a little trap at this point, however. On 
the one hand, we may accept the assertion that the usual student achievement 
indices will not be adequate for evaluation. But, on the other hand, the more 
closely we tailor our evaluation criteria to a particular model of instruction, 
the more we may be subject to the criticism that we cannot use those criteria 
very generally, or for comparisons of instructional methods. It does seem to 
be a hollow victory, in that sense, to establish that method X is superior to 
method Y In relation to an outcome which only method X ever purported to develop 
i n the f i rst p lace. 

This apparent de lemma can be resolved, however. First of all, we might 
observe that our intention should seldom be to compare two methods ner se^ in 
any event. Not only are such ^Mohn Henry'* comparisons unlikely to produce 
consistent significant results, but they are also unlikely to provide much infor- 
mation we can use in improving instruction. Whatever useful data are sought 
are also frequently confounded by complex aptitude treatment interactions which 
have seldom led to clear, imp lementab le prescriptions for individualizing 
i nstruction. 

Secondly, when we have carefully specified and analyzed our purposes and 
goals, the aim of evaluation is to help us make better decisions about how to 
reach those goals. Thus, I concur with Stuff lebeam et al. (1971) that we must 
distinguish more carefully between research and evaluation In education. In 
eva I uation of instructional innovations, I believe we should be primarily con- 
cerned with Information that will help us to determine whether we are successful 
Ji> reaching our goals, and to locate areas In which changes or Improvement are 
needed. Research concerning the relative effectiveness or differing conse- 
quences of two or more methods or procedures may also be very important, but 
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ft represents a much different problem. With these purposes for evaluation, tt 
Is appropriate that the criteria should be selected on the basis of their 
usefulness In relation to the goals and purposes of the specific instructional 
approach. Our question thus becorres, '^What criteria will provide evidence 
that we can use to make better decisions about our ability to attain the goals 
and purposes?" 

As a tentati ;e response, I shall propose three general categories of 
evaluation criteria for Innovative Instructional approaches: (1) basic psycho- 
logical aptitudes and traits; (2) student reports; and (3) internalization 
and application. These are summarized In Table 2, 

Criteria In level one, basic psychological aptitudes and traits , are con- 
cerned more specifically with the question, ^'Has the learner changed, as an 
individual, in predicted ways?^' In this category, we are concerned with using 
our analysis of goals and purposes to. formulate in advance specific hypotheses 
about the development of certain fundamental cognitive abilities or personal 
characteristics of the learner. In our LCI approach, for example, we would make 
predictions concerning the development of specific aptitudes and traits related 
to creative thinking, independent Inquiry, and problem-solving, as illustrated 
in Table 2. These variables are often readily defined operationally, because 
of their limited scope. An obvious difficulty Involved at this level, of 
course, is that the fundamental aptitudes and traits may not be able to be 
Interpreted, or translated, directly Into specific principles for instructional 
design or revision. Our efforts to formulate hypotheses about such fundamental 
psychological variables may have substantial value, however, In studying indi- 
vidual aifferences or trait-treatment Interactions. 



Criteria in level two, student reports , include two fundamental sub-divisions 
student Indications of attitud es or preferences In relation to the methods or 
content and assessment of student acquisition of specific content . In this cate- 
gory, we are concerned with the development of the learner's attitudes and 
preferences, In relation to the purposes of Instruction, and with the learner^s 
knowledge in relation to the Instructional objectives which comprise the content 
of the course. Student ratings of courses and instructors are always problematic 
of course. The assumptions about Instruction which are frequently ^'bullt In^* 
to most standardized rating scales may be especially detrimental to obtaining 
useful data for evaluating innovative approaches. Nonetheless, we should be 
concerned about the students' feelings and preferences for our methods and for 
the content with which they have worked, and the value of such data should not 
be dismissed too lightly. We may need, therefore, to develop student attitude 
or preference inventories which represent adequately the parameters of the 
instructional model being employed. 

In most Instructional programs, we generally assume that the learner does 
acquire some content, and we usual ly attempt to foster more complex kinds of 
learning and thinking than merely recognition and recall. Given that such 
intentions are i ncorpo rated In our goals and purposes. It Is necessary to Include 
assessment in these areas as part of our evaluation of the approach, (it is not 
necessary, of course, to i elate this assessment to the question of assignment 
of grades to students.) If our goals and purposes propose that students should 
have opportunities for application, analysis, synthesis, and evaluation, as well 
as for knowledge and comprehension. It does follow that we should seek some evi- 
dence that these complex outcomes have been reached, as we attempt to establish 
the effectiveness of the approach. 
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Criteria in level three are described as i nterna 1 1 zatlon and app I ication 
criteria. These criteria deal, In the most general sense, with the competence 
of the learner In relation to the goats and purposes of Instruction, We are 
concerned with the student's personal recognition and acceptance of the goals 
and purposes, and with the student's ability to demonstrate proficiency outside 
our classroom and beyond the contrived environment of tests, course assignments 
or projects, and ratings. From the most practical point of view, we have not 
accomplished very much if we have only produced incompetent students who are 
fluent on paper and who ''enjoyed'^ our course. Beyond this, I am certain, we 
want to believe that they have grown, and that they can now cope more effectively 
with their "real world^' and Its problems. But how can we tel!? 

It would be appropriate, ! suppose, for us in educational psychology, to 
base our evaluation upon some evidence that a person, as a result of our instruc- 
tion, solves problems more effectively in an actual teaching situation. But 
to collect such data, or to presume that we could attribute what we observed 
to our instruction, seems improbable as we operate today. As a result, we 
have had to retreat from the student^s ^''reai world" to attempts to simulate that 
World. The use of micro-teaching, for example, often accompanied by video-taped 
performances which can be reviewed and critiqued, has become a popular method for 
determining whether the student has increased in actual competence. This method 
is time-consuming, however, and requires space and equipment not always readily 
available. In addition, it focuses most often on the jcqulsltlon and demon- 
stration of highly specific skills, such as questioning strategies, or reinforce- 
ment techniques, and thus does not really create a p rob I em situation for the 
student, 

-.^ 3 need to develop simulated problem-solving situations , which can be related 
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to the student personal course of study during the course of Instruction. 
These should be selected by the student, and presented In a form which does not 
require special space or equipment. The presentation must be sufficiently . 
"open" to give the student control, but sufficiently programmatic to sample ade- 
quately all aspects of the instructional goals and purposes. There must be many 
possible courses of action and solutions, with mechanisms for providing new 
input as the problem progresses. We must be able to obtain Information from the 
student about his choices and decisions, the steps he takes throughout the problem, 
the strategies he employs, as well as his solution or "exit'* from the problem. 
Preliminary work from the Berkeley Creativity Project (Olton, et al., 1967; 
Covington, In press) and from the work of one of my students (Speed le, 1973) 
suggests that we can develop programmed" approaches to the assessment of problem 
solving with elementary school students. Our next task Is to extend this work 
to problems which are relevant for col lege students In our LCI courses; we are 
currently beginning such an effort. 

Charles Sliberman, in his piercing Crisis In the Classroom (1970) has proposed 
that one of the greatest problems confronting American education, at every level, 
is "mindlessness.^' We should be sensitive to this problem as we develop innovative 
approaches to instruction. We must devote considerable effort to the formulation 
and analysis of goals and purposes, which provide us the essential foundation 
for the development of Instructional procedures and for the identification of 
new and more adequate criteria for evaluation. 
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Table ) 

Goals and Purposes of LCI: Description and Analysis 



Purposes of LCI 


Relation to Cognitive 
and Affective 
TaxonomI as 


Relation to 
Torrance Definition 
of Creative Thinking 


Relation to Parnes 
Creative Problem 
Sol vi ng Model 


Providing an envi- 
ronment for growth 

-containing re- 
srouces (people, 
th 1 ngs , 1 1 me , 
space) ; 

-fostering trust, 
encouragement, 
support (psycho- 
logical safety). 


Awareness 

Wi 1 11 ngness to 

rece I ve 
Willi ngness to 

respona 
sati sfactlon 1 n 

response 


Becoming sensitive to 
problems, defl-i 
ciencles, gaps In 
know (edge, ml ss 1 ng 
e lements, dl s- 
harmonles , , . , 


Fact finding 


With opportunities 
to learn to 

-identify personal 
needs and goals 

-relate goals to 
the Instructional 
doma i n 

-develop plans to 
reach goals, 
satisfy needs 


Know 1 edge, 
comp rehenslon, 
analysis, 
synthesis 


Identlfyl ng the 
difficulty 

Searching for sol u- 
tions, making 
guesses, f ormu- 
lating hypotheses 


Problem finding 
Idea finding 


-carry out those 
plans, using 
appropriate re- 
sources and 
strategies 

-make decisions 
and judgments 

-use information 
and solutions 

-formulate new 
problems and 
cha 1 lenges 


Comp rehension, 
appi ication, 
analysis, 
synthesis 

Eval uation 

Apl ication, 

o y M 1 I 1 ^ 


Testing and re- 
testing the 
hypotheses, with 
possible modifi- 
cations 

Communicati ng the 
results 


Idea finding 
and solution 
f Indi ng 

Acceptance 
f indi ng 



And to learn to 
recognize and 
respond to 

-one's own physi- 
cal , persona \ 
and emotional 
traits 

-resources, pro- 
blems, goals and 
needs of other 
people 

-problems, re-- 
sources, and needs 
Q a changing world 
ERIC society. 



Receiving 
Responding 
Va I ui ng 



( 1 denti fyi ng 
di f f iculties, 
searching for 
sol utions, 
Communicati ng 
results) 



Problem finding, 
solution 
finding and 

Acceptance 
finding 



Table 2 



Criteria for Fvaluatfng Instructional 
Innovations (with Illustrations for LCI) 

I.evel I; Basic Psy chological Aptitudes and Traits 

Underlying psychological abilities and characteristics which are related to 
the attainment of goals and purposes. 

I -A: Cognitive Aptitudes (Creative thinking abilities; structure of 
Intellect abilities Involving: cognition, divergent production, 
and evaluation of semantic and behavioral products) 

I- B: Personal Characteristics (self-actualization; independence fn 

thought and judgment; Internal locus of control; self-confidence) 

Level II: Student Reports 

Student ratings of attitudes and preferences for methods and content and 
Indices of student attainment of specific instructional objectives. 

II - A: Student rati nqs (student attitudes towards course environment and 

resources, instructor's assistance and support, opportunities for 
self-direction of learning, relevance of instructional material 
and resources to student objectives) 

ll-B: Attainment of Objectives (projects, papers, and reports demonstrating 
accomplishment In relation to specified objectives at several levels. 
Including application, analysis, synthesis, and evaluation as well as 
basic knowledge and comprehension) 



Level IM: Internal I zatj on and Application 

Evidence that the student has accepted for himself the goals and purposes, 
and demonstration of the student's competence outside the instructional 
setting. 

Ill-A: Observation in Natural Settings (Observation of the student's applica- 
tion of learning In solving problems confronted In an actual teaching 
situation) 

llt-B: Simulation of Problem Situations (Opportunities to observe and evaluate 
student competence in se I f -management of learning and problem-solving 
under laboratory conditions which realistically approximate actual 
teaching experiences). 

IM-C: Measures of Problem-Solving (Student^s performance on measures which 
stress application of knowledge and skills in complex tasks rather 
than recall or recognition alone.) 



